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Abstract 



We prove the curse of dimensionality in the worst case setting for numerical inte- 
C^ ' gration for a number of classes of smooth d-variate functions. Roughly speaking, we 

consider different bounds for the derivatives of / S C^{D^) and ask whether the curse 
of dimensionality holds for the respective classes of functions. We always assume that 
D^ C W^ has volume one and consider various values of k including the case k = oo 
which corresponds to infinitely many differentiable functions. We obtain necessary and 
sufficient conditions, and in some cases a full characterization for the curse of dimen- 
sionality. For infinitely many differentiable functions we prove the curse if the bounds 
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on the successive derivatives are appropriately large. The proof technique is based 
on a volume estimate of a neighborhood of the convex hull of n points which decays 
exponentially fast if n is small relative to d. For k = oo, we also also study conditions 
for quasi-polynomial, weak and uniform weak tractability. 

1 Introduction 

We study the problem of numerical integration, i.e. of approximating the integral 

Sci{f)= f f{x)dx (1) 

over an open subset Dd C M"' of Lebesgue measure Xd{Dd) = 1 for integrable functions 
/ : Dd — )■ M. In particular, we consider the case of smooth integrands. The main interest is 
on the behavior of the minimal number of function values that are needed in the worst case 
setting to achieve an error at most e > 0, while the dimension d tends to infinity. Note that 
classical examples of domains Dd are the unit cube [0, l]'^ and the normalized Euclidean ball 
(with volume 1), which are closed. However, we work with their interiors for definiteness of 
certain derivatives. Obviously, this does not change the integration problem. 

For arbitrary sequences {Dd)d&n, we prove that numerical integration suffers from the 
curse of dimensionality for certain classes of smooth functions with suitable bounds on the 
Lipschitz constant that depend on d. The curse of dimensionality means that the minimal 
number of function evaluations is exponentially large in d. This paper is a continuation of 
our paper [7] with the following new results: 

• We use nontrivial volume estimates, see Theorem 2.1 and 2.3. 

• We obtain matching lower and upper bounds for Lipschitz functions, see Theorem 3.1. 

• We obtain matching lower and upper bounds for functions with a Lipschitz gradient, 
see Theorem 4.1. 

• We provide better lower and upper bounds than in [7] for functions with higher smooth- 
ness, see Theorem 5.1. 

• We obtain results for C°° functions, see Theorem 16.11 and 17.11 In particular, in this 
case we study quasi-polynomial, weak and uniform weak tractability. 

We always assume that Xd{Dd) = 1 but, in addition, we need further assumptions on Dd, 
like convexity and/or bounds on the radius of Dd- 
Technical tools used in this paper include: 



• Bounds for the volume of {x G M"^ | dist{x,K) < 7}, where K is the convex hull of 
n points, and dist is the Euclidean distance of a point x from K, see Theorem 2.1 
and 2.3. 

• Properties of the convolution derived mainly in [^, see Theorem 2.4. 

2 Preliminaries and Tools 

2.1 Complexity 

In this section we precisely define our problem. Let F^ be a class of continuous integrable 
functions / : Z^^ — > M. For / G F^, we approximate the integral Sd{f), see ([T]), by algorithms 

An,dif) = 0n,d(/(a;i), fix2), • • • , fiXn)), 

where Xj G D^ can be chosen adaptively and (j)n,d : M" — )■ M is an arbitrary mapping. 
Adaption means that the selection of Xj may depend on the already computed values 
/(xi), f{x2), . . . , /(xj_i). The (worst case) error of the algorithm A^^d is defined as 

e{An,d) = sup \Sdif) - An4{f)\. 

Then the information complexity n{e, Fd) is the minimal number of function values which is 
needed to guarantee that the error is at most e, i.e., 

n{e,Fd) = min{n | 3 An^d such that e(A„_rf) < e}. 

Hence, we minimize n over all choices of adaptive sample points Xj and mappings (j)n,d- It 
is well known that as long as the class Fd is convex and symmetric we may restrict the 
minimization of n by considering only nonadaptive choices of Xj and linear mappings 0n,d- 
Furthermore, in this case we have 

n{e,Fd) =mm{n\ inf sup \Sd{f)\<£}. 

xi,X2,...,Xn(^Da j^p^^ /(xj)=0,j=l,2,...,n 

In this paper we always consider convex and symmetric Fd so that we can use the last formula 
for n{e, Fd). It is also well known that for convex and symmetric Fd the total complexity, i.e., 
the minimal cost of computing an e approximation insignificantly differs from the information 
complexity. For more details see, for instance. Chapter 4 in [TU] . 



By the curse of dimensionality we mean that n(e, Fd) is exponentially large in d. That 
is, there are positive numbers c, Sq and 7 such that 

n{e, Fd) > c (1 + 7)^^ for all e < Sq and infinitely many d &fi. (2) 

There are many classes Fd for which the curse of dimensionality has been proved for numerical 
integration and other multivariate problems, see [TOl [12] for such examples. In this paper 
we continue our work from [^. 

2.2 Function Classes 

Already in [7j we considered classes of functions with bounds on the Lipschitz constants of 
all successive directional derivatives up to some order r. This will also be one of the main 
smoothness assumptions in this paper. To make clear why this is a natural assumption we 
now comment on the relation between usual and directional derivatives in terms of norms of 
higher derivatives viewed as multilinear functionals. To this end, let Vt G |Drf,M''j and let 
/ : fi — )■ M be an r-times continuously differentiable function. We denote the class of r-times 
continuously differentiable functions on Vt by C^(r2). The corresponding classes of infinitely 
differentiable functions are similarly denoted for r = 00. 

For k = l,...,r, the fc-th derivative f^'^\x) at a point a; G fi is naturally considered 
as a symmetric fc-linear map f^'^\x): (M'^)'^ — )■ M. Let W^~^ be the unit sphere in W''. For 
9 G S"'"^ let D^f{x) = lim/i^o j[{f{x + hOi) — f{x)) be the derivative in direction 6. For 
example, in the case k = 2 the second derivative is the bilinear map defined by the Hessian. 

For 9i, ... ,9k G S'^^^, the successive directional derivative in the directions 9i, ... ,9k is 
then given as 

D'>>'...D<^^f{x) = f^'\x)i9„...,9k) 

and is independent of the ordering of the derivatives. 

The norm of such a /c-linear map A : (R'^)'' — > M is given as 

\\A\\=snp{\A{9i,...,9k)\ \ ^i, . . . ,4 G S^-^}. 

Since the polarization constant of a Hilbert space equals one, see [3l Proposition 1.44], this 
norm is also equal to 

\\A\\=snp{\A{9,...,9)\ \ 9^^"-'}. 

For k < r and / G C""(fi), let us denote 

ll/('^ll = ll/('^l|oo=sup||/«(a;)|| 



and 

up(/<'.,. sup yy-fyi 

Then 

Lip(/('=)) = sup Up{D^'...D^^f)= sup Up{D^...D^f). 
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6»i,...,6»fce§d-i 6»eS' 

Moreover, for k < r we have 

||/(^+i)||=Lip(/('=)). 

If we need to emphasize the domain Q in these notations, we will write ||/|n|| and Lip(/|n)- 
As usual, f^'^^ = f in the case k = with 

||/IL=sup|/(x)|. 
xeQ 

We will use these facts without further comment. 

We now describe the function classes we consider in this paper. The functions shall be 
defined on Q. To make lower bounds for the information complexity as strong as possible, 
the function class should be as small as possible. Analogously, to make upper bounds as 
strong as possible, the function class should be as large as possible. That is why we use two 
kinds of function classes. For lower bounds, we require bounds for the Lipschitz constants 
of certain directional derivatives. 

To make this precise, fix a r G No := {0, 1, . . . } and a double sequence 

L = {Lj^d)j<r,d£l^ 

of positive numbers. Now we define the function classes 

C,^(L) = {/ G C^{D,) I ll/IU < 1, Lip(/(^)) < L,,, for all j<r}, (3) 

and 

C'.iL) = {f\n, I / G C^iR"), ll/IU < 1, Lip(/(^)) < L,,, for all j<r}. 

Obviously, 

We use the corresponding notations also for r = oo. 

Although we are mainly interested in results for C^{L), we will sometimes prove lower 
bounds on the information complexity for C^J^L) which imply the same lower bounds for C^[L). 



2.3 Convex Hull 

As already mentioned in the introduction, the lower bounds on multivariate integration 
presented in this paper are based on a volume estimate of a neighborhood of certain sets 
in W^. Generally, these sets are convex hulls (or their neighborhoods) of n points in the 
set fi C M*^. Since we need the v«-scaling of the distance throughout this article, we will 
omit it in the notation from now on. For instance, we denote by As the ((5v«)-neighborhood 
of A C M'^, which is defined by 

As = {xeR'^\ dist(a;. A) < 5^}, (4) 

where dist{x,A) = iniafzA \\x — a\\2 denotes the Euclidean distance of x from A. We also 
denote by Bf{x) the d-dimensional Euclidean ball with center x G M'^, and radius 5yd^ i.e., 

Bf{x) = {yeR'^l \\y - x\\^ < 6Vd}. 

We begin with a result that holds for arbitrary sets D^ as long as their radius is small enough. 
The radius of a set Dd C M.'^ is defined by 

rad(Drf) = inf sup ||y — a;||2. 



We prove the following theorem. 

1 r\/^iTnrlorl titt^ n \ .( / ) .1 — 1 o n rl lo-f /-? — 

Vd 



Theorem 2.1. Let D^ C R'^ be bounded with Xd{Dd) = 1 and let R = I^^i^. Let K be 



the convex hull of n points Xi, . . . , x„ G D^- Then 

Xd{Ks) < n((R + 25)J^^ 

This is exponentially small for R < 4 /— ^ 0.4839 and 5 < l/v^27re — \R. 



Some of our results will be based on this estimate and thus, for convenience, whenever 
we refer to sets {Dd) with small radius we simply mean that 

,. rad(D,) AT , , 

hmsup ^ — <\ — . (5) 

d^oo Vrf V 7re 

Note that, unfortunately, this result does not cover the most natural case of the unit cube 
for which R = 1/2, but the Euclidean ball of volume 1 is covered. Because of the importance 
of the unit cube we will treat it separately after the proof of the theorem. 
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Proof. Observe that for bounded Dd the infimum in the definition of the radius rad(Dd) is 
actually a minimum. Let 2; G M*^ be a point where this minimum is attained. By the result 
of Elekes [1], the convex hull K is contained in the union of the n balls, say C^*\ with center 



z = 1, . . . ,n, and radius {R/2)\fd. Recall that \d{Bf) < (^6\/27re) , see e.g. (6) in [7]. 



Z+Xj 

2 ' 

This implies that 



Ks C [JCP. 

1=1 

Thus, for any i we have 



D 



We now turn to the case of the unit cube. First, we state a lemma that bounds the 
volume of the intersection of the cube with a single ball. Additionally, we estimate a value 
of the involved constant that will be important later. 

Lemma 2.2. Let z = (1/2, . . . , 1/2) be the midpoint of the cube and assume that 

\xi — Zi\ = 1] ioT i = 1, . . . ,d. 



Then, for every 5 < \Jrf + 1/12, there exists a constant 7 = 7(5, r^) < 1 such that 

In particular, 7(1/4 + 1/100, 1/4) < |. 

Proof. First note that, by symmetry, it is enough to consider Xi = Zi + t], i = 1, . . . ,d. Let 
B = Bf{x). By considering an independent random variable X = {Xi, . . . ,Xd) uniformly 
distributed in [0, l]'^, the volume of 5 fl [0, l]'^ can be expressed as 

Xd(B n [0, 1]*^) = p( ||X - XII2 <6Vd\ = rfj^i^i - V2 - v)^ < 6^ d) 

= FlexpL(5'd-J2iXj-l/2-vA\ > 1 j , 

where a > is a free parameter. Define the random variables 

Y,=exp{a(^S'-iX^-l/2-r^Y^], 



such that 



A,(5n[o,if) =p(nr, > l). 

V,=i / 



We now use Markov's inequahty 

P(F> 1) < E(F), 
which holds for all non- negative random variables Y, and obtain 

(d \ X d \ d 

1['^,>i)<eIiIyA=i[ey,. 

The last equality follows from the independence of the Yj. It remains to prove 

E{Y,)<-f{6,v)<l 

for a suitable choice of a. To this end, observe that 

6^ -{x- 1/2 - r]Y = 6^ - (1/2 + r]f + 2a;(l/2 + r]) - x'^ for x eR, 

and that 

/■I 

E{Yi) = / cxpia(6^-{l/2 + r]y + 2x{l/2 + r])~x^]\dx 

is a differentiable convex function in a with value 1 at a = 0. Thus, ]E(Yi) < 1 for small 
enough a > if and only if ^E(Yi)|^^q < 0. We get 



-E(ri)|^^Q = f (^5^-{l/2 + rif + 2x{l/2 + ri)-x^^dx 



d 
da 

6^-{l/2 + r]y + {l/2 + r])-l/3 
6^-rf-l/l2, 



which is less than () ii 5^ < rf + 1/12. This proves the statement of the lemma. 
Note that we can choose 

/I 
exp iaU'^ - (1/2 + rjf + 2a;(l/2 + 7])- x^\ \ Ax. 

The bound on 7(1/4 + 1/100, 1/4) is estimated numerically by Geogebra, using a = 9/2. D 



Using this lemma we prove the following volume estimate for a neighborhood of the 
convex hull of n points in the cube. 

Theorem 2.3. Let K be the convex hull of n points Xi, X2, . . . , x„ G [0, l]*^. Then, for every 
5 < ^, there exists a constant 7 = 7(5) < 1 (depending only on 5) such that 

A,(ir,n[0,l]'^) < nid+l)^". 

In particular, 7(1/100) < |. 

Proof. We closely follow the proof of Theorem 3 in [8] , which is based on the results from 
Elekes in [4j and Dyer, Fiiredi, McDiarmid in [6]. 

First, it follows from Caratheodory's theorem that K C [0, 1]"' is contained in the convex 
hull of at most k = n{d + 1) vertices of the unit cube [0, l]'^. So, to prove the claim of the 
theorem, it is enough to show that 



Ad(K5n[0,l]") <k^{6y 



where K C [0, 1]*^ is the convex hull of k vertices of [0, l]''. Note that K^ cannot be a subset 
of [0, l]'^ for S>0. _ 

By Elekes' result from [1], i^ is contained in the union of k balls with radius y/d/A and 
centers in the midpoints of the segments from the corresponding vertex to the midpoint of the 
unit cube, i.e. the coordinates of the midpoints of the balls, say i/ij, satisfy i/ij G {1/4, 3/4}. 
This implies that Kg is contained in the union of the k balls with the same centers and 
radius (1/4 + 6)Vd. That is, 

k 

Ks C [jCsiy,), 

1=1 

where yi = (?/j,i, . . . , yi^d) satisfies yij G {1/4, 3/4}, i = 1, . . . ,k, j = 1, . . . ,d, and Cs{yi) = 
{x G M'^ I ||x - yi\\2 < (1/4 + 6)Vd}. Hence, 



i=l 



Since \yij — Zj\ = 1/4 for alH = 1, . . . , fc and j = 1, . . . ,d, where z = (1/2, . . . , 1/2), we 
can apply Lemma [2.21 to obtain the result with 7(5) = 7(1/4 + 6, 1/4). D 



2.4 Convolutions 

In this section we recall a result from [7] which is the main ingredient for our proof of the 
curse of dimensionality for classes of smooth functions. Roughly speaking, given an initial 
function, this result shows that convolution with a (normalized) indicator function of a ball 
preserves certain "nice" properties of the initial function, while increasing the degree of its 
smoothness by one. 

For convenience, throughout this section we study functions that are defined on M.'^. As an 
obvious corollary of Theorem 12. 4l below we will obtain that the restrictions of the constructed 
functions to the unit cube satisfy the same bounds. 

To be precise, fix a number S > 0, k eN and a sequence (oj)^^^ with aj > such that 

k 

i=i 

For example, we may take aj = 1/k ioi j = 1,2 . . . ,k. Later we will let k tend to infinity. 
Then the sequence aj = Cr, ■ j~^~'' with some r] > and c^ = ttjtjtt will be our choice. Here, 
( denotes the Riemann zeta function. 
For j = 1, . . . , /c, we define the ball 

Bj = IxeW^l \\x\\2 < ajSVdl 

and the function Qj : M*^ — )■ M by 

,,(x) = M:^ = ^^ ^'"^^- (6) 

Xd{Bj) Xd{Bj) lo otherwise. 
Recall that the convolution of two functions / and g is defined by 

{f*9)ix) = f f{x-t)g{t)dt, xeM.''. 



Additionally recall from Section 12.21 that by the Lipschitz constant of / we mean 

r. .,^ \f{x)-f{y)\ 
Lip(/) = sup . 

xy^y \\x-y\\2 
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Theorem 2.4. For A; G N and / E CiR'^), define 

fk = f *9i* ■■■*9k with Qj from ©. 

For (i > 2, let f2 C W^ be Lebesgue measurable and let Vt^ be its neighborhood defined as 
in dH). Then 

{€) if /(x) = for all x eVL^ then /a;(x) = for all x G fi, 

(u) Lip(A) < Lip(/), 

[iii) if j^ f{x + t)dx>e for all t G R'^ with ||t||2 < (5-\/^ then J^ /fc(a;)dx > e, 

(iv) for all £ < r and all Oi, ^2, ■ ■ ■ , ^r G S"'~\ 

Lip Td^^ D^^-1 . . . D^i /fc) < Lip (d'^' D^'-^ ...D^^f\ 
iv) fk G C"+'=(M'^), and for all ^ < r, all j = 1, . . . , fc and all ^1, ^2, • ■ ■ , O^+j G S"'-\ 
Lip('D^^+^ D^.+.-i z^si/^^ < m ^ J Lip^D^^ D^^-1 . . . D^V 

In particular, 

Lip(/i^^) < Lip(/W) for all i<r, 



[vt 



[Vll] 



Lip(/r^'^) < (riLi ^)j Lip(/^'^) for alU < r and j = 1, . . . , k. 



See [7] for the proof of {i) through (t>). Properties {yi) and (fu) are consequences of {iv) 
and (w), respectively. 

3 Lipschitz Functions 

In this section we consider Lipschitz functions. The results of Sukharev piij imply the curse 
of dimensionality for multivariate integration for the class 

F, = {/: [0,1]<^^M I Lip(/)<1}. 
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We prove the curse of dimensionality for smaller classes of Lipscliitz functions. Roughly 
speaking, the curse holds iff the Lipschitz constant in dimension d is of the order (i~^/^ or 
larger. 

In the notation of Subsection 12.21 we consider the classes 



C^,{L) = [f:Da^m \ ||/|U < 1, Lip(/) < Lo,d =: L,}, 

where L = (L^) and the sequences (-Drf)^^^ satisfy the following property. 

We say that {Dd)d£N satisfies Property (P) if it is a sequence of open sets with \d{Dd) = 1 
such that there exist a sequence {x*^)deN, x*^ € Dd and R < oo with 

lim \d{{x e Dd I \\x - x*i\\2 > nVd}) = 0. (P) 



d— >oo 



In particular, (P) holds for all sequences with ia,d(Dd) of order y/d or the sequences of 
£p-balls, p > 0, with volume 1. For a derivation of the last statement see [H]. 
The main result of this section is the following theorem. 

Theorem 3.1. Assume that the sequence {Dd)den satisfies (P). Then the curse of dimen- 
sionality holds for C^{L) if and only if 

limsupLfi Va > 0. 

d—^oo 

We prove lower and upper bounds separately in the next two subsections. 

3.1 Lower Bounds 

Here we prove the curse for the classes C^{L) of functions that are restrictions to D^ of 
functions on M*^ with ||/|| < 1 and Lip(/) < L^. This implies also the curse for C^{L). 

Proposition 3.2. The information complexity for the class C^{L) satisfies 

n{e, C°(L)) > (1 - ae) I "^1_ j for all e G (0, 1/a), deNanda>l. 

This implies the curse of dimensionality for the class C°(L) if 

limsupLrfVa > 0. 



d— >cx) 
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Proof. Since C°(L) is convex and symmetric, we know that adaption does not help, see [2]. 
Hence, for given d and n, we may assume that the information on / is given by function 
values f{xi), f{x2), ■ ■ ■ , f{xn) for some xi, . . . , x„ G Dd- Let K = {xi, . . . , x„} and consider 
the function 

7(x) = mm{l,Lddist{x,K)} for all x G R'^. 

Since dist( ■ , K) has Lipschitz constant 1, we have / := /|^ G C°(L). Let 



-"5 V-^j;, 



where Bf{xi) is the ball with center Xj and radius 5yd = j^. Note that f{x) = 1 for all 
X ^Vs- We obtain 

/ fix)dx > I /(x)dx = l-XdiVsnDd) 

> l-XdiVs) > l-n\d{Bt). 
It is shown in [TJ eq. (6)] that 

UBt) < ^ ^/ ■ 
VTra 

Therefore, 

/ /(x) dx > 1 ^ — ^ > 1 - n — 

J Da VTcd \LdVd j 

The bound on n(£:,C°(L)) for a = 1 follows. 

Now assume that a > 1. It follows from C^^{aL) C aC^^^l^L) that 

n(£,C°(L)) = n{ae,aC'^d{L)) > n(a£,C°(aL)). (7) 

A simple substitution using the result above for a = 1 in the above inequality leads to 



(.,C°(L))>n(a.,C°(aL)) > (1 - «^) [^^ 



This implies the curse for a := limsupLj^v^ > 0. Indeed, for any r] G (0, a) it is enough 
to take a > ^ ^'^^ . Then the lower bound on n{e,C^{L)) is exponentially large in d for 

e < Eo = -. D 

" a 

Note that Proposition 13.21 leads to a super-exponential lower bound on the information 
complexity, if L^ decays slower than d"^/^. 
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3.2 Upper Bounds 

In the last subsection we proved the curse of dimensionahty for function classes with (roughly 
speaking) Lipschitz constant bounded from below by a positive multiple of 1/yd. In this 
subsection we complement this result by proving upper bounds which are simply based on 
one point formulas. That is, assuming (P), a single evaluation of the function is enough to 
obtain an arbitrary small error as long as d is large enough and lim^^oo L^yd = 0. Recall 
that our function classes are defined by 



C°(L) = {/: D, ^ M I ll/IU < 1, Lip(/) < L,}. 
Proposition 3.3. Assume that the sequence {Dd)d&i satisfies (P). Let 

lim LdVd = 0. 

Then the information complexity for the classes C^{L) satisfies 

n{e,C'd{L)) = 1 
for all e G (0, 1) and d > d{e) large enough. 
Proof. We use the one point formula 

where we choose the x*^ as provided by Property (P). With R > from Property (P), we 
obtain for / G C°(L) that 



\Sdif)-A,M)\ 



(fix)- fix:)) dx 



D, 



< 



DanBf,{x*^) 



{f{x)-f{x*,))dx 



ifix)-fix:))dx 



DABiixD 



Hence, 



<Ld / \\x - x*\\2dx + 2\d{Dd\Bi{x*^)) 

<RLdVd + 2\d{Dd\Bi{x*d)). 

e{A,,d) < RLdVd + 2 Xd{Dd \ Bi{x*d)) , 
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which tends to zero with d approaching infinity. This proves that n{e, C^{L)) < 1. To finish 
the proof we need to show that n{e, C^{L)) > 0. Even for L^ = 0, the class C^{L) contains 
all constant functions f{x) = c for c G [—1,1]. If n{e,C^{L)) = then we can use only 
constant algorithms Aq^^ = «, where a is independent of /. Taking / = 1 and / = — 1 we 
have 

e(v4o,d) > max(l — q;|, | — 1 — a;|) > 1 > £. 

Hence, n{e,C^{L)) cannot be zero, and this completes the proof. D 

4 Functions with Lipschitz Gradients 

In this section we want to strengthen the results from the previous section by proving the 
curse of dimension for a smaller class of functions. In fact, we impose bounds on the Lipschitz 
constants of the derivatives of the functions that are of order 1/d (instead of l/y/d). 

Now we can no longer assume arbitrary domains for the lower bounds. The essential 
geometric property of the sets D^ that we need is that a sufficiently large neighborhood of 
the convex hull of n points in D^ has very small volume as long as n is not exponentially 
large in d. We proved such estimates in Section 12.31 for sets with small radius and for the 
unit cube. Recall that 

C',{L) = {fe C\D,) I ll/IU < 1, Lip(/) < Lo,,, Lip(V/) < L^,,}. 

The main result of this section is the following theorem. 

Theorem 4.1. Let Dd be the cube (0, 1)"^, a ball of volume 1 or, more generally, a convex 
set of small radius in the sense of ([5]) with Ad(-Drf) = 1. Then the curse of dimensionality 
holds for C\{L) if and only if 

lim sup L^d yd > and lim sup Lid d > 0. 

d—^co d—^oo 

Again, we prove lower and upper bounds separately in the next two subsections. Then 
Theorem 14.11 is a direct consequence of Propositions 13. 2[ 14. 2[ 14.31 and 14. 8[ 

4.1 Lower Bounds 

Assume that (-Dd) is a sequence of convex sets of small radius or the unit cube. To prove the 
curse of dimensionality for the class C^{L), we proceed as in Section [3TT] and show the curse 
for the smaller class C\{L). For this we construct, for given sample points xi, . . . , x„ G Dd-, 
a fooling function that is defined on the entire W^ and fulfills the required bounds on the 
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Lipschitz constants. This function will be zero at the points Xi, . . . , x„ and will have a large 
integral in D^ as long as n is not exponentially large in d. Moreover, this function will be 
zero in a neighborhood of the entire convex hull of xi, . . . ,a;„. Unfortunately, we were not 
able to construct a fooling function that is zero only at xi, . . . , x„ (as for Lipschitz functions). 
Such a function would probably be an important step towards an improvement of the results 
of this paper for the case of higher smoothness. 

Let : M*^ — 7- M be the squared distance function, which is defined as 



ix) = distfx, Ka 



\2 



where K is the convex hull of the n points Xi, . . . , x„ G -D^ and Ks is defined as in (jl]). The 
function obviously vanishes on Ks- Let Pxg : M.'^ ^ Kg be the nearest neighbor projection, 
i.e., Pks{x) is the unique point in Ks given by 

\\x --Pft-^(a;)||2 = dist{x, Ks). 
It follows from Theorem 3.3 in [5] that is differentiable with gradient 

V0(x) = 2{x-PK,ix)). 
Since Pks is a contraction, this also implies 

||V0(x) - V0(i/)||2 < 4||x-y||2 for all x,y eR"^. 

That is, V0 is Lipschitz with constant Lip(V0) < 4. 

The fooling function will now be the restriction of a function of the form 

f =po(f) 

with as above and with some bounded and smooth function p: 1R+ — )■ R+. Before we state 
our choice of p explicitly, we now show how (and which) properties of p imply the needed 
properties of /. First, if we assume that p{0) = 0, we obtain /(x) = for all x G Ks- 
Moreover, we have 

, < IIpIIoo :=max|p(t)|. 



so bounds on function values of p directly translate into bounds on function values of /. 
Assuming differentiability of p, we obtain the formula 

V/(x) = p'(0(x))V0(x) = 2p'{dist{x, Ksf){x-PK,{x)). i 

This implies 

||V/(x)||2 = 2p'{distix,Ksf)distix,Ks). 

16 



So any uniform upper bound on the function 2y/tp'(t) is also an upper bound for ||V/(a;)||2 
for all X G R'^. Note that 

\D'fix)\ = I {e,Vfix)) I < ||V/(x)||2 for all 6 e S'-\ 

This gives an upper bound on all directional derivatives of / of order one, and thus a bound 
on the Lipschitz constant of /. Additionally, for all 6 G S'^~^ we have 

J. .^0,, \D'fix)-D'f{y)\ \{e,Vf{x)-Vf{y))\ 

Lip[D J) = sup = sup 



x-yh x.veR'* \\x-y\\2 



which implies a bound on the Lipschitz constant of the (first-order) derivatives of / given a 
bound on Lip(V/). But, if we assume p{t) = 1 for t > 6^d, then Vf{x) = for all a; G M'^ 
with dist{x, Ks) > 6\/d, i.e., for all x ^ K2S- This gives 

Lip(V/) = Lip(V/|^,J. 

Using ([8]) we obtain 

|(V/(x) - V/(y)) = p'{dist{x,Ksf){x-PK,ix)) -p'{dist{y,Ksf){y-PKM) 
= p'{dist{y, Ksf) [x - Pk,{x) -y + PkM) 

+ (p'{disi{x,Ksf) -p'{d:ist{y,Ksf)) [x - Pk^^)). 



The norm of the first term can be bounded by 2||]9'||oo ||x — y\\2: whereas, for x, y G K25-, the 
second term is bounded by 

Lip(p') dist{x,Ksf -d\st{y,Ksf di?,t{x,Ks) 

< Lip(p') ||x — y\\2 (dist(x, Ks) + dist(?/, Ks)) dist(x, Ks) 

< 25'^dLii){p) \\x — y\\2. 

Here, we used dist(a;, Ks) < Sy/d for x G K2s- This yields that 

LippV) < Lip(V/) < A{\\p'\U + 6'dUpip')). 
In summary, we want to construct a different iable function p : IR+ — t- ]R_|_ such that 
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(a) p(0) = 0, 

(b) \\p\L = 1> 

(c) p{t) = 1 for t > 5^d, 

(d) 2^/ip'{t) < ^ for allt G M and 

(e) A{\\p'\\^ + 5'dUp{p')) < ^. 

These properties, once verified, imply that flo^ € C^{L) with / = p o 0, where 

2 . 40 



^0,d 



and Lij = tti- 



We now give an exphcit construction of such a function p. We use the function 

4^, if t < ^, 

if t > 5^d. 

We obtain immediately the properties {a)-{c) for p. Furthermore, p is continuously differ- 
entiable with derivative 

{^, if t < ^, 

0, if t > 6^d. 

Using this, we obtain property (d). For (e) observe that p' is absolutely continuous and thus, 
almost everywhere differentiable with derivative 

1 0, otherwise, 

for all t ^ 1^, (5^(i}. It is well known that in such cases the Lipschitz constant of p' is equal 
to the supremum of |p"(t)| over t ^ {^5 (5^(i}. This proves that Lip(j9') < 8/{5'^d'^) and thus, 

, , 2 86^d\ 40 
< 4 — - + 



6^d 6M^ 6^d' 



This proves the last property (e). 

The following result shows the curse for a specific choice of the bounds L* = (Lq ^, L^ ^)d£N 
and thus, for every L that is a constant multiple of L*. If we consider the domains to be 
unit cubes, we obtain 

Proposition 4.2. Let D^ = (0, l)*^. For 

r* _ 400 , ,, _ 16 ■ 10^ 

we have 

n{£,C\{L*)) > ^^ ( ^ j for all rf G N and e G (0, 1). 

Hence, the curse of dimensionality holds also for the class C\{L) if 

lim sup Lo,(i yd > and lim sup Li^ d > 0. 

d—^oo d—^OD 

Proof. Let 6 = 1/200. As discussed above, the restriction / = /l^j^ satisfies / G C]i{L*). It 
remains to bound its integral in D^. By property (c) of p we have f{x) = 1 for all x with 
dist{x,Ks)^ > 6'^d, i.e. for all x ^ K2S- Then Theorem 12.31 implies 



/ fix) dx> [ fix) dx = 1 - \,iK2s n [0, l]-^) >l-nid+l) (l) . 

This proves the curse for C^(L*) if limsupLo,^ vu > 400 and limsupLi^c? > 2^^. Similar 
arguments as in the proof of Proposition 13.21 (using C^iaL) C aC\iL) for a > 1) conclude 
the proof in the general case. D 

We now consider the class of domains with small radius. The proof follows exactly the 
same lines but with the use of Theorem 12.31 replaced by Theorem 12. 1[ Furthermore, in 
contrast to Theorem 14.11 we do not have to assume now convexity of the domains Dd- 

Proposition 4.3. Let iDd)d&i be a sequence of sets with small radius in the sense of (jS]). 
Then the curse of dimensionality holds for the class C^(L), if 

lim sup Lod yd > and lim sup Lid d > 0. 

d—^oo d—^oo 



19 



Proof. We present only a sketch of the proof, since it is almost identical to the proof of Propo- 
sition |121 First, note that for every set of small radius there exists a 6 > such that Xd{K2s) 
is exponentially small in d, where K is the convex hull of n points in Dd, see Theorem 12.11 
Choosing this 6 in the above construction of the fooling function / (and its restriction /) 
shows the curse for the classes C^{L) with lim sup Lo,d V^ > C and limsupLi^rfd > C for 
some C < oo. Again, we obtain the result by scaling. D 

Remark 4.4. Note that the calculations of this section could be done also with the function 
dist(x, K)"^ which vanishes only on K instead of Kg. This would have somewhat reduced the 
constants in Proposition 14.21 For convenience we worked with (p as above, since we need this 
function also in Section [51 

Remark 4.5. With similar ideas as used in [^, it is not possible to produce super-exponential 
lower bounds on the information complexity in the cases of Proposition 14.21 and 14.31 The 
reason is that even with very small S (depending on d) the volume of the (5vu-neighborhood 
of the convex hull cannot be super-exponentially small. However, we conjecture that the 
information complexity is super-exponential for slightly larger classes, e.g., if the conditions 

lim sup Lo,d Vtt > and limsupLi ^c? > 



are replaced by 



d— >oo d— >oo 



lim sup Lqii yd = oo and lim sup Li^d d = oo. 

d— >oo d— >oo 



Remark 4.6. Note that instead of this rather complicated function p it would be possible 
to work with the function p{t) = t/{6'^d) to obtain essentially the same result. But in this 
case one would have to do the analysis directly for the functions restricted to the subsets 
Dd C M'^ and, in addition, one would obtain the desired lower bound on the information 
complexity only for sufficiently small e and not for all e < 1 as above. 

4.2 Upper Bounds 

In the last subsection we proved the curse of dimensionality for function classes with (roughly 
speaking) Lipschitz constant of the gradient bounded from below by a positive multiple 
of 1/d. In this subsection we complement this result by proving matching upper bounds. 
Again using a one point formula is enough to ensure an arbitrary small error as long as d is 
large enough and \im.d->oo -^i,d d = 0. 

We present two versions of this result. One that holds for convex sets with Property (P) 
and one that holds for arbitrary convex domains. 
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Again, we want to deal with a function class as large as possible. Therefore, we drop the 
bounds ll/lloo < 1 and Lip(/) < Lo,d and consider 

F] = {/: D, ^ M I Lip(V/) < Li,4 D C\{L). 

Proposition 4.7. Let Dd be convex. Then the information complexity for the classes C\{L) 
and -Fj satisfy 

n(e,C](L)) = n(£,F]) = l 

provided that Li^d diam(i5d)^ < ^i where diam(Dd) is the diameter of the set Dd- Hence, if 

lim Li^d diam(Z:'d)^ = 0, 

then 

n(5,C](L)) = n(e,F]) = 1 

for all e G (0, 1) ii d> d{e) is large enough. 

Proof. We use the one point formula Ai^dif) = f{z) where z G Dd is the centroid (center of 
gravity) of Dd- Then we have 

SdU)-AUf)= [ {fix)-fiz))dx= [ rix)dx 



'Dd JDa 

with 

rix) = fix)-fiz)-Vfiz)-ix-z) 

since the integral over Dd of the function a-{x — z) vanishes for any a G M'^. We estimate r(x) 
by using the mean value theorem, which implies the existence of a point y on the segment 
[x, z] such that 

f(x)-fiz) = Vf{y)-ix-z)- 

^From the Cauchy-Schwarz inequality we conclude that for / G -Fj we have 

\r{x)\ = \{Vf{y)-Vf{z))-{x-z)\<\\Vf{y)-Vf{z)h\\x-zh 
< Li^d \\y - z\\2 \\x - ;z||2 < Li^d \\x ~ z\\l < Li^d diam{Ddf- 

Hence, the error of Ai^d on F^ is bounded by Li^ddiam(Dd)^ and tends to zero for d — > oo. 
Therefore, the curse of dimensionality is not present since n{e,F^) < 1 for any e > and 
large enough d- Repeating the argument used in the proof of Proposition 13.31 we conclude 
that n{e, Fj) = 1, as claimed. D 
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Note that Proposition 14.71 is already enough to prove the respective part of Theorem 14.11 
However, the next proposition shows that, if the sequence {Dci)d<^N satisfies (P), then the 
curse does not hold if Li^dd tends to zero. Note that, if the -D^'s are £f -balls (which satisfy 
(P)), Proposition 14.71 would require that Li^dd'^ — ^ instead of Li^dd — )■ 0. 

Unfortunately, we can not omit the bound on the supremum of / as above. Therefore, 
we consider the classes 

F^ = {f:Dd^R I ll/lloo < 1, Lip(V/) < Li,4 D C](L). 

Proposition 4.8. Let (-Dd)deN be a sequence of convex sets that satisfies (P). Additionally 
assume 

lim Li^dd = 0. 

Then the information complexity for the classes C^{L) and F^ satisfy 

n(e,C](L)) = n(£,F]) = 1 

for all e G (0, 1) if c? > d{e) is large enough. 



Proof. We use the same techniques as in the proofs of Propositions 13.31 and 14.71 Now, the 



algorithm is the one point formula Ai^d{f) = f{z) where z E Ddis the centroid oi DdCiB'^^xl 



where R and xjj are from (P). Set B = Bf^{x'^). Then we have 

Sdif) - A,M) = [ ifi^) - /(^)) dx = / f(x) dx+ [ (fix) - fiz)) dx 

JDa JDanB J Dd\B 

with 

rix) = fix)-fiz)-Vfiz)-ix-z) 

since the integral over Dd CiB oi the function a- [x — z) vanishes for any a G M'^. We estimate 
r{x) in the same way as in the proof of Proposition 14.71 (using diaia{Dd H 5) < Ryd) and 
the second term as in Proposition 13.31 (using ||/||oo ^ !)• We obtain 

\Sd{f) - ^,d(/)| < R^L^A d + 2Xd{Dd\ B) 

for all f E F^, which, under the assumptions of the proposition, tends to zero for d — )■ oo. 
The rest is as before. D 
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5 Functions with Higher Smoothness 

In this section we deal with the general classes 

C'AL) = {fe C\D,) I ll/IU < 1, Lip(/(^)) < L,,, for J = 0, 1, . . . , fc }. 

For A; > 1, our lower and upper bounds will not match anymore even if Dd = (0, 1)'^. The 
upper bound is proved using Taylor's formula which leads to an additional factor l/vu for 
each additional derivative. In the proof of the lower bound we will use the smoothing by 
convolution which does not give any additional gain in the bounds for the higher derivatives. 
We are stuck with 1/d starting from r = 1. 

The main result of this section is the following. 

Theorem 5.1. Let Dd be the cube (0, 1)'^ or a set of small radius in the sense of ([5]). For 
all k eN, the conditions 

lim sup Lo,rf yd > and lim sup Lj^ d > for j = 1, . . . ,k 

imply the curse of dimensionality for C^iL). 

On the other hand, if D^ is convex and there exists j G {0, 1, . . . , fc} such that 



lim Lj^d d '^ =0 



then the curse does not hold. 



5.1 Lower Bounds 

The lower bounds on the information complexity in this case are mainly based on Theo- 
rem [231 which shows that convolution with certain indicator functions, see ([6]), increases the 
smoothness of the initial function by loosing only a factor in the bounds on the Lipschitz 
constants of the higher order derivatives. 

For this, recall from Section [27^ that we have fixed a number 5 > 0, £ G N and a sequence 

{c(jYj=i with aj > such that 

i 

^a,<l. 
i=i 
For the purpose of this section we choose aj = l/£ ioi j = !,...,£. 

Additionally, recall that gj is the normalized indicator function of a ball with radius 



a 



j5yd and that we define 
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Let Xi, . . . ,Xn G -Drf be the sampling points and K their convex hull. The initial function 
for the convolution will be the function / : M'^ — ;■ M that was constructed in Section H?T1 This 
function satisfies the following properties: 

• /(x) = for a; G Ks, 

• /(x) = 1 for a; ^ K2S, 

• Lip(/) < ^, and 

• Lip(/«) < ^,. 

By Theorem 12.41 we immediately obtain 

• fi e C'+\ 

• fi{x) = ioT X E K, 

• fi{x) = 1 for X ^ Kss, 

• Up{fi) < ^ and 

• Ll,:=Up{f</'>)<^^{IY-\j = l,2,...,i+l. 

Thus, setting £ = A; - 1, we have filo^ G C^(-^*) C C^{L*), where 

2 , _ 40 /A;-!^^'"^ 



^°"^ = ^ ""^ ^-^^ = ^1^ for , = l,...,fc. (9) 

By the third property of fe we additionally obtain 

f Mx)dx>[ feix)dx = l-XdiKssHD^). 

JDa JDa\K3s 

Using the upper bounds for the volume on the right hand side from Section 12.31 which 
were already used in the proofs of Proposition 14.21 and 14.31 we obtain the desired lower 
bounds on the information complexity. In particular, we obtain for small enough positive 6 
(depending only on the sequence {Ddjden), that there exists r] = ri{6) > 1 such that 

n{e,C'AL*)) > {l-e)r]' (10) 

for all fc G N, £ G (0, 1) and infinitely many d G N, where the sequence L* is given by iQ. 

Using the same scaling technique that was used in Sections 13.11 and 14.11 we obtain the 
curse of dimensionality under the assumptions of Theorem 15. 1[ 
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Remark 5.2. If Dj^ is the cube we could also give an explicit lower bound on the information 
complexity for the class C^{L*) with L* = {L* ^) from above. In fact, the same lower bound 
as in Proposition 14.21 holds for every A; G N if we set 5 = 1/300. 

5.2 Upper Bounds 

We now prove that the curse of dimensionality does not hold if the condition 

j+i 
lim Lj^d d ^ =0 

holds for some jG{0,l,...,fc}. We first observe that the cases j = and j = I were already 
dealt with in the previous sections. For j G {2, 3, . . . , k}, we use the next proposition. Note 
that we prove the result under the assumption that the sets satisfy Property (P). Both, the 
cube and sets of small radius, satisfy this assumption. 

Proposition 5.3. Let [Ddjd&n be a sequence of convex sets that satisfies (P). Additionally 
assume that there exists j G {2, 3, . . . , k} such that 

lim Lj^dd 2 =0. 

Then the information complexity for the classes Cd{L) satisfies 

n{e,C'd{L)) <eU^ 

for all e G (0, 1) if c? > d(e) is large enough. 

Proof. Let the sequence {Xd)deN and -R < oo be provided by Property (P). Assume first that 
j G {2, 3, . . . ,k — 1}. Then we take a Taylor polynomial of order j at the point x*d G Dd 
which can be written as 

y^.(^)^^/;!Mlp^ for all xeDd. 

Here we use the standard notation A{x^) = A{x, . . . ,x) for the evaluation of an ^-linear map 
on the diagonal. Recall that we consider here f^^\x*d) as an ^-linear map. It is well-known 
that the error of the approximation of / by Tj can be written as 
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For X E Dd with ||a; — a;j||2 < Ryd we can now estimate the error 



as 



J! Jo 



\f{x)-T,{x)\<- / (l-tydt||/(^-+i) 






If j = k, we use the same approximation and note that 



f{x) - Tfc(x) = f{x) - Tk-i{x) - 



f^\xl){x -x, 
k\ 



*\k 



(j + 1)! 



k / (l-tf-^r^{t)dt 



with 



r^t) 



fik) (3,* + t(^ _ ^*)) (^ _ ^*)fc _ /(/c) (^*) (^ _ ^*) 



A;! 



Then for x G -D^ with ||a; — x*^\\2 < Ryd, we get 



Lip(/('=))t ||a:-a:*||'+' i?'=+i ,.,. , 

pu ; II ^^^< ^^_^^— forte[0,l], 



fc+1 



A;! 



A;! 



and 



Dfc+l 

|/(:r)-T,(a:)|<^L,,,ci+ 



A;! 



So we have for all j G {2, 3, . . . , A;} we have 



|/(x)-T,(x)|<^L,,,rf^ 
if ||a; — x^||2 < Ryd. For all such j, consider the algorithm 



Q.,d(/) 



/ T,(x) dx= y: ^4r^ / n (^. - ^hY' dx. 



Since 



< 1, we obtain 
f{x)dx - Qj^if) 



i3--m<j 



DdnBf,(x'^) . ^ 



Dd 



< 



{f{x) -Tj{x)) dx 



DdnB^ix"^) 



DABiixl) 



f{x) dx 



< / \f{x)-T,{x)\dx + X4D,\BUx:)) 



< 



j! 



L,,,dV + Ad(D,\5^(x*)). 
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By the assumptions of the proposition, both terms tend to zero as d goes to infinity. Thus, 
Qj,d yields an arbitrary small error if the dimension is large enough. 

It remains to bound the cost of Qj,d- First note that Qj^d is not an admissible algorithm 
since we can compute only function values. However, it is easy to see that we can approxi- 
mate each partial derivative D^f{x*) by divided differences with an arbitrary precision by 
computing only a number of function values that does not depend on the dimension d (but 
on 1/3 1 < j < k). More precisely, we can compute Qj^dif) for / ^ C^{L), j < k, up to an 
arbitrary error rj > using 



(for d,j > 2) function values of /, see [I^. The proposition follows. D 

5.3 Partial Derivatives 

In this section we comment on results that can be deduced directly from the already proven 
statements. In particular, we state results for classes C^{L) that are defined like C^{L) 
from ([3]), but with conditions on arbitrary directional derivatives replaced by conditions 
only on partial derivatives. The results follow solely by inclusion. 
We define the function classes by 

C',{L) = (/ G C\Dd) I ll/lloo < 1, sup Up{D^f) < L,,d for all j < k 

It is easy to see that for each / G C^{Dd) and j < k 

sup Lip(D'^/) < sup Up{D^^ . . . D^' f) = sup Lip(D^..D7) 
= Lip(/(^)). 
Let ^ = (^1, . . . , Od) e §^-1 and x,y e Dd- Noting that 



L/i/> 7 1 kJ iXj jr^ • • • (_/ jy y 



we obtain 
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|/(^)(x)(^,...,^)-/(^)(y)(0,...,^)| < fX^l^.lV sup \D^f{x)-D^f{y)\ 

\7^i J m=j 

< d?'^ sup \D^f{x)-D^f{y)\. 
This implies Lip(/*^''^) < dp/'^ supi^i • Lip(D^/) and thus 

for arbitrary double sequences L = {Lj^ii)j,dm- An immediate consequence is that all previ- 
ously proven lower bounds on the information complexity for C^{L) also hold unchanged for 
C^{L). Moreover, we obtain from Theorem 15.11 the following proposition. 

Proposition 5.4. Let D^ be the cube (0, l)*^ or a convex set of small radius in the sense 
of ([5]). Then, for all fc G N, the conditions 

lim sup Lo,d Vtt > and lim sup Lj^d d > for j = 1, . . . , /c 

d—^oo d—^oo 

imply the curse of dimensionality for C^{L). If there exists j G {0, 1, . . . , fc} with 

lim Lj^d d^^^ = 
then the curse does not hold. 

6 Functions with Infinite Smoothness 

In this section we deal with C°° functions. The classes we consider are now of the form 
CTiL) = {feC^iDd) I ||/|U<1, Lip(/(^))<L,,,forj = 0,l,2...}. 
The main result of this section is 

Theorem 6.1. Let Dd be the cube (0, 1)'^ or a set of small radius in the sense of ([5]). Then 
the conditions 

limsupLo,d Va > and limsupLj^^fi > c(j!)^^'' for j E N, 

d— >oo d—^oo 
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where c, 77 > 0, imply the curse of dimensionahty for C^{L). 

On the other hand, if D^ is convex and there exists j G N with 

j+i 
hm Lj^d d "2 =0 

then the curse does not hold. Furthermore, if there exist constants c < 00 and 5 > such 
that 

Lj,d < c{2 + 5y 3\ d-"^ 

for all j, d G N, then the problem of numerical integration for the classes C^{L) is quasi- 
polynomially tractable, i.e., 

ln(n(e,Crf°^(L))) < C(l - lne)(l + Inrf) 

for some absolute C < 00. 

6.1 Lower Bounds 

To prove lower bounds for the classes C^{L) we basically use the same fooling functions (fk) 
as in Section ISTTl but with a different sequence (aj). Moreover, we need to take the limit for 
k ^ 00. For this reason, we first study the convolution of infinitely many indicator functions 
Qj. The resulting function in the one- dimensional case is reminiscent of the up- function of 
Rvachev, see [13] . 

Recall the definition iQ of the Li-normalized indicator functions Qj of the ball of radius 
ajSyd for j G N. Now we define 

Gk = gi* . . .gk- 

Observe that G2 is Lipschitz and G3 G C^lW^). Theorem 12.41 implies that Gk is also Lipschitz 
for A; > 2 with Lip(G'fc) < Lip(G2) and, more generally, Gk G C^(R"') for A; > ^ + 1 > 1 with 

Lip(Gf ) < Lip(Gg,). 

This implies that the limit function 

Goo = hm Gk 

exists, the convergence is uniform. Goo G G°°(]R^) and 

G^^ = hm Gf 

fe— >oo 
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uniformly for all i > 0. Indeed, fix a direction 6 E Ei'^ ^ and let Li be the operator of ^-times 
differentiation in direction 6. Then 

LeGn = Lf{Gi+:i) * gi+4 ■ ■ ■ * Qn 
for n > £ + 3 and the Li-normalization of Qn+i imply 



\LiGn+i{x) - LiGn{x) 



/ {LiGn{x-y)- Li>Gn{x))* gn+i{y)A.y 



< I \LiGnix - y) - LiGnix)\ * gn+iiy)dy 

'Sn + l 

< Lip{LiGn)an+iSy/d < Lip(G'^^2)^^"n+i- 



This leads to 



\LiGn+m{x) - LiGn{x)\ < Up{Gfl2)6Vd ^ 



ak 



k=n+l 

for all m > 1. Now the summability of the sequence (aj) shows that (^LiGn) is a uniform 
Cauchy sequence proving the claim. 

Now we can define our final fooling function 

Joo = / * ^00 

using again the initial function / constructed in Section 14.11 Then the functions 

fk = f *Gk 

converge uniformly to /oo- We also have uniform convergence of the corresponding deriva- 
tives. By induction, we obtain the following properties from Theorem 12.41 

• /oo G C-, 

• foo{x) = ioT X E K, 

• foo{x) = 1 for X ^ K3S, 

• Lip(/oo) < ^ and 

. LI, := Lip(/(^)) < 1^ f nCi ^Y J = 1, • • • , ^ + 1- 



30 



Using the sequence aj = c^j ^ '' for 77 > with c^ = ({1 + rj) ^ the last estimate yields 
. LI, := Up{0) < f6~''^cl'^{{j - 1)\Y^\ J = 1, ...,£+ 1. 
By the third property of fi we additionally obtain 

f fooix)dx>[ fe{x)dx = l~\diKssnDd). 

The proof of the lower bound in Theorem 16.11 is then finished exactly as in the case of finite 
smoothness k in Subsection 15.11 Note that in this case, we cannot use the argument of 
scaling for the class C^{L). Thus, the (j!)^^'' remains in the asymptotic lower bound for 

6.2 Upper Bounds 

We prove upper bounds on the information complexity for the classes C^{L) of infinitely 
different iable functions. First of all, note that Proposition 15.31 holds unchanged for k = 00. 
This is summarized in the following proposition. 

Proposition 6.2. Let {Dd)d&n be a sequence of convex sets that satisfies (P). Additionally 
assume that there exists j G N such that 

j+i 
lim Lj dd '^ =0. 

a— >oo 

Then the information complexity for the classes C^{L) satisfies 

n{e,C^{L)) <e^d^ 
for all e G (0, 1) if c? > d{e) is large enough. 

Again, this result only shows that, under the given assumptions, the curse of dimension- 
ality does not hold for C^{L). The next proposition improves this result in the sense that 
we obtain quasi-polynomial tractability, that is 

\n{n{e,C^{L))) < C{1 -\ne){l + \nd) for all e G (0, 1), rf G N, 

for some absolute C < 00, if the asymptotic conditions in the last proposition are replaced 
by uniform bounds. We prove two different variants of this result which differ by the power 
of the j\ in the required bounds. 
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Proposition 6.3. Let (-0^)^^^ be a sequence of convex sets and define Rd = Tad{Dci)/Vd. 
Additionally assume that there exist a > 1 and c > such that 

Lj,d < ca-^ jlR-J'^d"'-^ 

for all j,d e N. Then the problem of numerical integration for the classes Cf{L) is quasi- 
polynomially tractable. 

This proves the respective part of Theorem 16.11 since the cube and convex sets of small 
radius satisfy Rd < 1/2. 

For Dd = (0, 1)°' a similar result is contained in [18]. The paper p8] also studies other 
classes of C^ functions defined on the ball and upper bounds are obtained using Taylor 
approximat ions . 

Proof. The proof is completely analogous to the proof of Proposition 15. 3[ Recall the defi- 
nitions from there. In particular, we obtain in the same fashion for all j G N and x G Dd 
that 

|/(x)-T,(x)| < ^k^L.^dd"^ < ca-^ 
which is smaller than e > ii j > k^ := [log^(-)] . Thus, 



f{x)dx - Qk.Af) 



D, 



< e. 



Again, it remains to bound the cost of Qke,d- Exactly as in the proof of Proposition 15. 3[ 
see also [18], we can compute Qk^^dif) for / G C^{L), up to an arbitrary error rj > using 



ks 






^e 



function values. We conclude 

ln(n(e,C:f(L))) < k,{l + \Yid) < (1 + lnc)(l + l/lna)(l - ln£)(l + Ind). 

The proposition follows. D 

The last proposition of this section deals with the case where the (uniform) upper bounds 
on {Lj^d) have a smaller power of j!. This allows us to conclude weak tractability for sequences 
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(Dd) with slightly larger radii, i.e., rad(Dd) -< d^ ^, e > 0, while the order of d in (-^j,d) 
remains the same. Recall that numerical integration is called weakly tractable for C^{L) iff 

This means that n{e, C^{L)) is not exponential in d and in e~^ but can be exponential in c?" 
or e~°' for a G (0, 1). Obviously, the curse of dimensionality implies that weak tractability 
does not hold. However, the converse statement is not necessarily true, see e.g., [TUl 112] for 
more details. 

Proposition 6.4. Let {Dd)di^N be a sequence of convex sets and define Rd = Ta,d{Dd)/Vd- 
Additionally assume that 

for all j,d & N and some a,c,r] > 0. Then the information complexity for the classes C^{L) 
satisfies 

\ii{n{e,C^{L))) < (l + ei+i/''(/?,/a)2/'')(l + ln-)(l + lnrf) 

for all £G (0,1). 

In particular, the problem of numerical integration for the classes C^{L) is quasi- 
polynomially tractable for Rd < R < cxd, and weakly tractable for Rd < Rd^^^~^, R < cxd, 
(5 > 0, and r] > 1 -26. 



Note that the condition on the involved parameter a is weaker than in Proposition 16.31 
Since the proof is again analogous to the proof of Proposition 15.31 and the proof of 
Proposition 16. 3[ we omit the details. 

Remark 6.5. For function classes with bounds on the partial derivatives the analogue of 
Proposition 15.41 for /c = oo is also true. 

7 Weak and Uniform Weak Tractability 

In this section we study the notions of weak and uniform weak tractability and show that the 
problem is not uniformly weakly tractable as long as the bounds Lj ^ on the Lipschitz con- 
stants of the derivatives decay slower than any inverse polynomial in d. We prove this result 
without any additionally condition on the sequence of domains {Dd)den besides \d{Dd) = 1. 
This is surprising since we already proved polynomial (in d) upper bounds on the informa- 
tion complexity if one Lj^d decays (roughly) faster than rf'^-^+^^Z^ and the dimension is large 
enough depending on e, see Propositions 13. 3^ 14.81 and \5^ 
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The concept of weak tractability was recently strengthened in [T3] by introducing the 
notion of uniform weak tractability, which holds for multivariate integration defined over the 
class C^{L) iff 

lim / ' ^^ '' = for all a e 0, 1). 

For uniformly weak tractability, n{e, C^{L)) is not exponential in d°' and e~°' for all a G (0, 1). 
Now assume that the double sequence L = {Lj^d)j,deN satisfies 

lim sup Lj,(i (i "" > 

for all j G {0, 1, . . . , k} and some m < oo. This means that there exists a constant c > for 
which Lj^d > cd~"^ for infinitely many d. 

We prove that under this condition the problem of numerical integration for the class 
C^{L), see Section \'2.'2\ is not uniformly weakly tractable, independent from the sequence 
{Dd)d£N- This also implies that the problem for C^{L) is not uniformly weakly tractable. 
For this recall the definition of the class Fd^k,s from [TJ Sec. 4]. It follows from the definition 
of Fd,k,s that 

Fd,k := {/Id, I / G Fd,k,s for 5"^ = 2VT8^] C C'M'^L) 

for infinitely many (i G N. This leads to 

nM-'",C,^(L)) = n{e,d'^C',{L)) > n{e,C^,{d'^L)) > n{e , C'.id^ L)) > n{e,Fd,k) 

for all e G (0, 1) and infinitely many d. We know from [7j Thm. 2] that the right hand side of 
this inequality is bounded from below by (1 — e)2'^, see also [H Remark 1]. We now choose 
a sequence ((ij,ej)jgN = ((ij, |(i~™')jeN, such that limj rfj = oo and n(ej,C|. (L)) > 2'^*~^ for all 
i G N. The limit in the definition of uniform weak tractability is then lower bounded by 

^. lnn(ld-,C|(L)) (c^.-l)ln2 

lim sup — > lim — ; — > U 

d^J d- + (id—) -" - *-~ df + 2-dr 

if we take a < m~^. This contradicts uniform weak tractability for the classes C^{L) for all 
finite k. 

We now turn to the case k = oo. We prove uniform weak tractability for the classes 

CTiL) if 
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for all j,d E N and some fld, Q > 1 that may depend on d, where Rd = rad{Dd)/\/d. The 
upper bound on the information complexity from Proposition 16.31 (see the last inequality in 
the proof) implies that 

\nn{e,CT{L)) < (1 + lncd)(l + l/lnad)(l - ln£)(l + Inrf). 

Plugging this into the definitions of weak and uniform weak tractability we obtain 

Theorem 7.1. Let {DdjdeN be a sequence of convex sets and define Rd = Taud{Dd)/\/d. 
Additionally assume that 

Lj,d < Cd j! a~^ R'J~^ d-"^ for all j, deN. 
Then 

• the problem of numerical integration for the classes C^ (L) is uniformly weakly tractable if 

Cd < d"^ and ad > l + l/(lnd)"^ 
for some m < oo, 

• the problem of numerical integration for the classes C^ (L) is weakly tractable if 

Cd < exp(rf*i) and a^ > 1 + 1/d^^ 

for some 6i, 62 ^ [0, 1) with 61 + 62 < 1- 

Theorem 17.11 states, in particular, that weak tractability of numerical integration holds 
for the unit cube Dd = (0, 1)*^ and for the classes C^{L) if 

Lj,d < Jl {2 - Odil)y d-"^ e^' 

for all j, deN. 
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